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Abstract. An urn contains balls of d > 2 colors. At each time n > 1, a ball is 
drawn and then replaced together with a random number of balls of the same 
color. Let A n = diag(yl n ,i , . . . , A n ( j) be the n-th reinforce matrix. Assuming 
EA n j = EA n> \ for all n and j, a few CLT's are available for such urns. In 
real problems, however, it is more reasonable to assume 

EA n j = EA n> i whenever n > 1 and 1 < j ' < do, 

liminf EA n i > limsupi?A„ , whenever j > dg, 

for some integer 1 < do < d. Under this condition, the usual weak limit 
theorems may fail, but it is still possible to prove CLT's for some slightly 
different random quantities. These random quantities are obtained neglecting 
dominated colors, i.e., colors from do + 1 to d, and allow the same inference 
on the urn structure. The sequence (A n : n > 1) is independent but need not 
be identically distributed. Some statistical applications are given as well. 



1. The problem 

An urn contains aj > balls of color j e {1, . . . , d} where d > 2. At each time 
n > 1, a ball is drawn and then replaced together with a random number of balls 
of the same color. Say that A n j > balls of color j are added to the urn in case 
X n .j = 1, where X n j is the indicator of {ball of color j at time n}. Let 

n 

N nJ = a j + }] X k ,jA k ,j 

k=l 

be the number of balls of color j in the urn at time n and 

7 _ N n j _ J2k=l X kj 

Fix j and let n — > oo. Then, under various conditions, Z n- j Zij\ for some 
random variable Z^y This typically implies M n j Z^y A CLT is available as 
well. Define in fact 

C„j = y/n (M n<j - and D n>j = y/n (Z rhJ - Z (j) ). 

As shown in |4(, under reasonable conditions one obtains 

(C nJ , D nJ ) — » N(0, Uj) x N(0, Vj) stably 
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for certain random variables Uj and Vj . A nice consequence is 

(M nJ ~ Z (j) ) = C nJ + D nd — ► Af(0, Uj + Vj) stably. 

Stable convergence, in the sense of Aldous and Renyi, is a strong form of convergence 
in distribution. The definition is recalled in Section O 

For (C n .j, D n j) to converge, it is fundamental that EA n j = EA n ,i for all n and 
j. In real problems, however, it is more sound to assume that 

EA n> j = EA 7lt \ whenever n > 1 and 1 <j< do, 

lim inf EA n i > lim sup EA n j whenever j > do, 

n n 

for some integer 1 < do < d. Roughly speaking, when do < d some colors (those 
labelled from do + 1 to d) are dominated by the others. In this framework, for 
j € {1, . . . , do}, meaningful quantities are 

C n,j = Vn (M*^ - Z* nj ) and D* n j = x/Tl {Z* n ] - Z (j) ) where 
M *, = Qk^j , z*<= Nn ' j 



If d = d, then D*j = £> nj and \C*j — C n j\ < If d < d, in a sense, dealing 
with (C*j, .D* ■) amounts to neglecting dominated colors. 

Our problem is to determine the limiting distribution of (C^j> f* j), under 
reasonable conditions, when do < d. 

2. Motivations 

Possibly, when do < d, ^ nj - and M Ut j have a more transparent meaning than 
their counterparts Z* • and M*^. Accordingly, a CLT for (C„j, is more 

intriguing than a CLT for (C*j, D* n j ). So, why dealing with {C* n j , D* n j ) ? 

The main reason is that (C nj , D n j) merely fails to converge in case 

lim inf EA n j > — lim inf EA n x for some j > do- (1) 

Fix in fact j < do. Under some conditions, Z n j with > a.s.; 

see Lemma [3l Furthermore, condition ([1]) yields y/n X)f=d +i ^">« 00 ■ (This 
follows from Corollary 2 of [9|] for d = 2, but it can be shown in general). Hence, 

d 

D* n j - D nJ > Z n> j \/n ^ Z n,i ^ oo- 

i = dg + l 

Since D* • converges stably, as proved in Theorem |4j D n j fails to converge in 
distribution under (fljl. 

A CLT for D n j, thus, is generally not available. A way out could be looking for 
the right norming factors, that is, investigating whether D n j converges stably 
for suitable constants a n . This is a reasonable solution but we discarded it. In fact, 
as proved in Corollary O (C n j, D n j) converges stably whenever 

lim sup EA n j < - lim inf EA n i for all j > do. (1*) 

n ' 2 n 

So, the choice of a n depends on whether ([I]) or (fl*|) holds, and this is typi- 
cally unknown in applications (think to clinical trials). In addition, dealing with 
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(C* ■, D^j) looks natural (to us). Loosely speaking, as the problem occurs because 
there are some dominated colors, the trivial solution is just to neglect dominated 
colors. 

A next point to be discussed is the practical utility (if any) of a CLT for 
(C* ■, D n J) or (C„j, D n j). To fix ideas, we refer to D n ^) but the same 

comments apply to (C„.j, D n j) provided a CLT for the latter is available. It is 
convenient to distinguish two situations. With reference to a real problem, sup- 
pose the subset of non dominated colors is some J C {1, . . . ,d} and not necessarily 
{I,...,*}- 

If J is known, the main goal is to make inference on Zu\, j G J. To this 
end, the limiting distribution of D* n j is useful. Knowing such distribution, for 
instance, asymptotic confidence intervals for Zu\ are easily obtained. An example 
(cf. Example [6|) is given in Section |U 

But in various frameworks, J is actually unknown (think to clinical trials again). 
Then, the main focus is to identify J and the limiting distribution of C* • can help. 
If such distribution is known, the hypothesis 

H : J = J* 

can be (asymptotically) tested for any J* C {1, . . . , d} with card(J*) > 2. Details 
are in Examples [7] and [8] 

A last remark is that our results become trivial for do = 1 . On one hand, this is 
certainly a gap, as do — 1 is important in applications. On the other hand, do — 1 
is itself a trivial case. Indeed, Zm = 1 a.s., so that no inference on Zn\ is required. 

This paper is the natural continuation of ■ While the latter deals with do = d, 
the present paper focus on dg < d. Indeed, our results hold for do < d, but they 
are contained in Corollary 9 of [4| in the particular case do = d. In addition to 
[1] , a few papers which inspired and affected t he p resent one are [l[ and . Other 
related references are 0, 0], [|, Q, 0, 0, [13]. 

The paper is organized as follows. Section [3] recalls some basic facts on stable 
convergence. Section [4] includes the main results (Theorem [4] and Corollary [5]). 
Precisely, conditions for 

(C* tj , D* nj ) — ► JV(0, Uj) x Af(0, Vj) stably and 
(C nJ , D n ,;j) — > Af(0, Uj) x Af(0, Vj) stably under JFJ) 

are given, Uj and Vj being the same random variables mentioned in Section [TJ As 
a consequence, 

«j - Z U) ) = C nJ + D* tj — > AA(0, Uj + Vj) stably and 
(M„,j - Zy)) = C nj + D„,j — > A/"(0, f/j + Vj) stably under (fl*|) . 

Also, it is worth noting that D* L j and D n j actually converge in a certain stronger 
sense. 

Finally, our proofs are admittedly long. To make the paper more readable, they 
have been confined in Section [5] and in a final Appendix. 

3. Stable convergence 

Let (CI, A, P) be a probability space and S a metric space. A kernel on 5* (or a 
random probability measure on S) is a measurable collection N = {N(uj) : uj G fl} 
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of probability measures on the Borel cr-field on S. Measurability means that 

N(cj)(f) = ( f(x)N(cj)(dx) 



is ,4-measurable, as a function of ui £ fl, for each bounded Borel map / : S — > M. 

Let (Y n ) be a sequence of 5-valued random variables and N a kernel on S. Both 
(Y n ) and N are defined on (£l,A, P). Say that Y n converges stably to N in case 

P{Y n £-\H) — ► E(N(-) | H) weakly 

for all H £ A such that P(H) > 0. 

Clearly, if Y n — * N stably, then Y n converges in distribution to the probability law 
E(N{-)) (just let H = 0). We refer to [| and references therein for more on stable 
convergence. Here, we mention a strong form of stable convergence, introduced in 
Let T — (J r n) be any sequence of sub-cr-fields of A. Say that Y n converges 
T-stably in strong sense to N in case 

E(f{Y n ) | T n ) N(f) for all bounded continuous functions / : S — > M. 

Finally, we give two lemmas from [3| ■ In both, Q = (Gn) is an increasing filtration. 
Given kernels M and N on S, let M x N denote the kernel on S x S defined as 

(M x N) (lu) = M(lu) x N(lu) for all u € fl. 

Lemma 1. Let Y n and Z n be S -valued random variables and M and N kernels on 
S, where S is a separable metric space. Suppose a(Y n ) c Gn and a{Z n ) C Goo for 
all n, where Goo — 0"(U n £? n ). Then, 

(Y n , Z n ) — > M x N stably 

provided Y n — > M stably and Z n — > N Q -stably in strong sense. 

Lemma 2. Let (Y n ) be a G-adapted sequence of real random variables. IfYl^L^ —^r- < 
oo and E(Y n+ i \ Gn) Y , for some random variable Y , then 

n V| "7 and -y Yk ^Y. 

fc>n k— 1 

4. Main results 

In the sequel, X„j and A n j, n > 1, 1 < j < d, are real random variables on the 
probability space (SI, ^4, P) and G = {Gn '■ n > 0), where 

£o = {0, fl}, g„ = CT(X fej , A fcJ : 1 < k < n, 1 < j < d) . 

Let N n j = aj + 2fc=i Xf. jAk j where aj > is a constant. We assume that 

d 

X n ,j £ {0, 1}, X n j = 1, < A n j < (3 for some constant 0, (2) 

i=i 

(j4 nj j : 1 < j < d) independent of Gn-i V o~[X n j ■ 1 < j <d), 
Z nJ = P(X n+hj = 1 | Gn) = d -j- a.s.. 

Z^i=l ■'Ml,* 

Given an integer 1 < e?o < ^, let us define 

Ao = if do = d and Ao = max hm sup £L4. n j- if do < d. 

d <j<d n 
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We also assume that 

EA nJ = EA n>1 for n > 1 and 1 < j < d , (3) 
m := limEA n i, m > Xq, qj := limEA^ for 1 < j < do- 

A few useful consequences are collected in the following lemma. Define 

do d 

S n = Y^ N n,i and S n = ^ 

i=l i=l 

Lemma 3. Under conditions l[2" ]) -([3" ]) . as n — ->■ oo, 

^ n a.s. 7 a.s. 



m and > m, 

rt rt 



d 



Z„ j ^> whenever do < d and A > — , 



i=d +l 

a.s 



Z n ,j Z(j} for each 1 < j < do, 
where each is a random variable such that Zu\ > a.s.. 

For d — 2, Lemma [3] follows from results in 0] and [l(J. For arbitrary d, it 
is possibly known but we do not know of any reference. Accordingly, a proof of 
Lemma [3] is given in the Appendix. We also note that, apart from a few particular 
cases, the probability distribution of Zu\ is not known (even if do — d). 

We aim to settle the asymptotic behavior of 

C n ,j = \fn (Mn,j — Z n j) , D n j = \fn (Z Th j — Z^j, 
C n,j = Vn (M* tj - Z* n j ) , D* n j = ^fn~ (Z* tj - Z {j) ), 
where j G {1, . . . , d } and 



M „, = ^ fc - 1 ^ , m* . = — ^ fc=1 y , z. 



Let A/"(a, b) denote the one-dimensional Gaussian law with mean a and variance 
b > (where Af(a, 0) = <5 a ). Note that Af(0, L) is a kernel on R for each real non 
negative random variable L. We are in a position to state our main result. 

Theorem 4. 1} conditions (HJ)-© hold, then 

C* d — ►JV(0,J7j) sia% and 
£)* ■ — > A/"(0, Vjf) Q -stably in strong sense 
for each j G {1, . . . , do}, where Uj = Vj — Ztj\(l — Zu\) 



and V i = -^ri n t 1 - z u)) 2 + Z U) * z w }• 

i<d ,i^j 



In particular (by Lemma\^ , 

(C* ;j , D* nd ) — ► JV(0, ^) x AA(0, sia%. 

As noted in Section [21 Theorem |4] has been thought for the case do < d, and 
it reduces to Corollary 9 of 4] in the particular case do = d. We also remark 
that some assumptions can be stated in a different form. In particular, under 
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suitable extra conditions, Theorem |4] works even if (A n ,i, . . . , A n> d) independent of 
Gn-i V a(X n ,i, ■ ■ ■ , X n> d) is weakened into 

(An t i, . . ., A n , d ) conditionally independent of (X nA , . . . , X n ^ d ) given Q n -\\ 

see Remark 8 of [4J. 

The proof of Theorem |4] is deferred to Section [5l Here, we stress a few of its 
consequences. 

We already know (from Section fj]) that (C n> j, D n> j) may fail to converge when 
do < d. There is a remarkable exception, however. 

Corollary 5. Under conditions ©-©J «/2Ao < m (that is, (fl*j) holds) then 
C n ,j — > A/*(0, ?7j) stably and D n j — ► fif(0, Vj) Q-stably in strong sense 
for each j € {1, . . . , do}. In particular (by Lemma\^j, 

{C n j, D nJ ) — ► Af(0, Uj) x Af(0, Vj) stably. 

Proof. By Theorem|4j it is enough to prove D* n . - D n j — > and C* , - C n ,j — ► 0. 
It can be assumed do < d. Note that 



i=d + l 

Y^ d d 1 M n i — — 

C n,j ~ C n,j = D n>j - D* n J + M n j y/n - o -. 

n + 2^i=l M n,i 

By Lemma[3]and 2 Ao < to, there is a > | such that n" X^=d +i ^- Thus, 

it remains only to see that \ph~M n ^ for each i > do- Fix i > do and define 
£n,i = Sfc=i Xk ''~^~ 1 ' r ■ Since : n > 1) is a (/-martingale and 

E ^{(^ + m - 1 M = E ^^rr^ ^ E ^ < - 

n n n 

then L n i converges a.s.. By Kronecker lemma, 

Since ^ Sfc=i — * ana - =o(k~ a ) a.s., it follows that 

_^ n _^ n— 1 

VnMn ti = —= y^{x kA - z k -i.i) h — -= Z ki ^ 0. 

v k=l v fe=0 

□ 

Theorem 2] has some statistical implications as well. 

Example 6. (A statistical use of -D* Suppose do > 1, conditions ([21)-© 
hold, and fix j < do- Let (V n j : n > 1) be a sequence of consistent estimators of 
Vj, that is, V n j — ► Vj and a(V n j) C T> n for each n where 

V n = a(Xk,iAk,i, X k:i : 1 <k <n, 1 <i<d) 
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is the (7-field corresponding to the "available data". Since (V n ,j) is C/-adapted, 
Theorem |4] yields 

(D* ., V^j ) — ► A/"(0, V, ) x <5va ^-stably in strong sense. 

Since do > 1, then < Z^ < 1 a.s., or equivalently V 3 > a.s.. Hence, 

D* 

^{v„ j>o} — — > A/"(0, 1) ^-stably in strong sense. 

\/Vn,j 

For large n, this fact allows to make inference on Zij\, For instance, 

provides an asymptotic confidence interval for Zu^ with (approximate) level 1 — a, 
where u a is such that Af(0, l)(u a , oo) = ~. 
An obvious consistent estimator of Vj is 

v n,j = —j { Qn,j (1 - Z 1hj ) 2 + Z 2 3 ^2 Qn,i } where 

mn = ELiEti^M and Qn . = ELA^ 

n n 
In fact, E(X n+ i 4 Al +l i \ Q n ) = Z, hi EA 2 l+l %) <ft for all i < d , so that 
Lemma [2] implies — > f/i. Similarly, m„ — ^ m. Therefore, — — > Vj. 

Finally, Theorem H also implies V*n (M* (J — Z w ) = C*j+D^j — ► A/"(0, L/,+V,) 
stably. So, another asymptotic confidence interval for Z^ is M* j ± ^ y/G n j 
where G nj is a consistent estimator of Uj + Vj. One merit of the latter interval is 
that it does not depend on the initial composition <2j, i = 1, . . . , do (provided this 
is true for G nj as well). 

Example 7. (A statistical use of C*j). Suppose 

EA n _j — fXj and var(yl„.j) = er| > for all n > 1 and 1 < j < d. 

Suppose also that conditions (JH)-© hold with some J C {1, . . . , d} in the place of 
{1, . . . , do}, where card(J) > 1, that is 

ji r = m > fi s whenever r € J and s (fc J. 

Both J and card( J) are unknown, and we aim to test the hypothesis Hq : J = J* 
where J* C {1, . . . , d} and card(J*) > 1. Note that Uj can be written as 

^• = §{(i-%))M + ^) E %)^ 2 }. ieJ. 

Fix j S J*. Under i?o, a consistent estimator of {/j is 

^• = ^t{(i-^-) 2 ^- + ^ E where 

^ 1 V-^ ^ ^ Efc=l Xk.iAks ^ 2 _ Efc=l -^k,» (-^fe.i — m n,i) 2 



E 



card(J*) ^ Ek=i*M 



s 
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Note that ^^Xy > 0, eventually a.s., so that fh n: i and ct^ , are well defined. 
Similarly m n > 0, eventually a.s., so that U n ,j is well defined. Next, defining C* ■ 
in the obvious way (i.e., with J* in the place of {1, . . . , do}), Theorem H] implies 

C* 

K nJ := I{u n , 3 >Q} /== — ► A/TO, 1) stably under Hq- 

The converse is true as well, i.e., K n j fails to converge in distribution to Af(0, 1) 
when Hq is false. (This can be proved arguing as in Remark 1 10( we omit a formal 
proof). Thus, an asymptotic critical region for Hq, with approximate level a, is 
{l-Krajl > w Q } with u a satisfying Af(0,l)(u a , oo) = 2, j n re al problems, some- 
times, it is known in advance that jo G J for some jo € J*. Then, j = jo is a 
natural choice in the previous test. Otherwise, an alternative option is a critical 
region of the type Uiej* {|-Kn,t| _^ u i} f° r suitable itj. This results in a more pow- 
erful test but requires the joint limit distribution of (K n ,i '■ * € ^*) under i? . Such 
a distribution is given in [J] when J* = {1, . . . , d}, and can be easily obtained for 
arbitrary J* using the techniques of this paper. 

Example 8. (Another statistical use of C*j). As in Example [7J (and under 
the same assumptions), we aim to test Ho : J = J*. Contrary to Example [71 
however, we are given observations Akj, 1 < k < n, 1 < j < d, but no urn is 
explicitly assigned. This is a main problem in statistical inference, usually faced 
by the ANOVA techniques and their very many ramifications. A solution to this 
problem is using C*^, as in Example after simulating the X n j. The simulation 
is not hard. Take in fact an i.i.d. sequence (Y n : n > 0), independent of the A^j, 
with Yq uniformly distributed on (0, 1). Let a* = 1, Zo,% = -g for % = 1, . . . , d, and 

3 

X i,j = I {Fo. 3 -i<Y <F 0d } where F 0>j = ^Z ,i and F 0j0 = 0. 

i=l 

By induction, for each n > 1, 

3 



n,z 5 

(=1 



X n +i,j — ^{F, l , J _i<y„<F„ ij } where F n j — ^ Z, 



F n i) = and Z„ 



Now, TJo can be asymptotically tested as in Example [JJ In addition, since Ak.i is 
actually observed (unlike Example [7j where only Xk,iAk,% is observed), m n ,i and 
i can be taken as 

~ ELliM and ^ ; = _m!^iM, 



Clearly, this procedure needs to be much developed and investigated. By now, 
however, it looks (to us) potentially fruitful. 

5. Proof of Theorem [4] 
Next result, of possible independent interest, is inspired by ideas in [1] and ||. 
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Proposition 9. Let T = (J- n ) be an increasing filtration and (Y n ) an J- '-adapted 
sequence of real integrable random variables. Suppose Y n — ^+ Y for some random 
variable Y and H n € T n are events satisfying P(H^ i.o.) = 0. Then, 

\Jn (Y n — Y) — > A/"(0, V) J- -stably in strong sense, 

for some random variable V, whenever 

E{l Hn (E(Y n+1 | T n ) - Y n ) 2 } = o(n- 3 ), (4) 



V^E{l Hn sup \E(Y k+1 | T k ) - Y k+1 \} — » 0, (5) 
n^2(Y k -Y k+1 ) 2 ^V. (6) 

k>n 

Proof. We base on the following result, which is a consequence of Corollary 7 of [Bj]. 
Let (L n ) be an T -martingale such that L n L. Then, \Jn (L n — L) — > A/"(0, V) 
T -stably in strong sense whenever 

(i) limy/EE{l Hn sup\L k -L k+1 \} = 0; (ii) n V (L k - L k+1 ) 2 -A V. 

™ fc>ra , . 

— A:>n 

Next, define the jF-martingale 

n-l 

Define also T n = E(Y n+1 - Y n \ T n ). By Q, 



fc>n k>n k>n 

-\oo 



In particular, J2k=o E\In k T k \ < oo so that X)fc=o ^H* ^fe converges a.s.. Since Y n 
converges a.s. and P(Ih„ 1 i- -) — 0, 

n-l 

L n = Y n — T k L for some random variable L. 

k=0 

Next, write 

{L n — L) — (Y„ - Y) = J2i L k ~ L k +i) - E( Ffe - Ffc +i) = £ 

fc>n fc>n /c>n 

Recalling 5Z fc >„|J r i? ife Ifc| — ► (thanks to Q), one obtains 



V^(L„-L)- Vn(T B -y) = V^|E T ' 

< ^ n i + E i C 1 - Ih * ) Tk 



k\ 

k>n 

P 



k>n k>n 



Thus, it suffices to prove y/n (L n — L) — ► A/"(0, V) JF-stably in strong sense, that 
is, to prove conditions (i) and (ii). Condition (i) reduces to ((5|) after noting that 
L k - L fc+ i = E{Y k+1 | T k ) - Y k+1 . 
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As to (ii), since L k — L k +i = Y k — Y k+ i + T k , condition |6|) yields 

nJ2(L k - L fe+ i) 2 = V + nJ2{ T k +2T k {Y k - Y k+1 )} + o P (l). 

k>n k>n 

By Q, E{nJ2 k > n lH k Ti} = n^of^) — 0. Since P{I Hn ± 1 i.o.) = 0, 



then nJ2 k > n T k — 0. Because of ([5]), this also implies 

{ n ^ T k (Y k - Y k+1 )} 2 <nJ2 if ' n " Ffe 



f. 



0. 



k>n 



k>n 



k>n 



Therefore, condition (ii) holds and this concludes the proof. 



□ 



We next turn to Theorem 21 From now on, it is assumed do < d (the case do = d 
has been settled in [J]). Recall the notations 5* = YliLi N n ,i and S n = Yli=i N n ,i- 
Note also that, by a straightforward calculation, 



Z n +i,j Z n 



do 



7* V — 



~* -X"n+l,t -^-n+1,' 



' J z— 1 

Proof of Theorem [4j The proof is split into two steps 
(i) D* n 3 — > J\f(0,Vj) ^-stably in strong sense. 



By Lemma [3 Z* , = z 

S* a.s. 



„ , - — 4 Z(jy Further, P(2S'* < nm i.o.) = since 

m. Hence, by Proposition [5J it suffices to prove conditions (JU)-©-© with 
Tn = Gn, Y n = Z* n3 , Y = Z (j) , H n = {2S* n >nm}, V = Vj. 
Conditions (@| and © trivially hold. As to (@|, note that 

do d 
Z n,j Z n ,i = Z n ,j 53 ^n,« = Z n ,j- 



i=l 



Therefore, 



A i ■ A i ■ 

E { Z n+l,j - Z n,j \Gn} = Z n j E{ — ' 3 - | } - Z*j 53 



4 2 



do 



S„} + , 53 , /:{ 



-^n+l.i 



^nWn + ^-n+l,j) 



+ j4n+l/ 
I Gn}, 



\Gn) 



so that I Hn E{Z* +1 . Z* n . I 0„}| < I Hn < 4 "'> 1 



As to ©, 



E[Zl +ltj | £ fe ) - Z* k+l j 
2(5 



< | + AT* 



< 



.s', : . 



( 



5fc+l 

_ 3/3 



S k +i 



i 



t 



so that I Hn sup| J B(Z* +1 . 3 | G k ) - < /if„ ^ < ^ - 
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Finally, let us turn to (J6j) . For every i€{l,...,do}, 
A 2 PA 2 

2 jp( 1± n+l,i I n 1 ^ 2^^+1,1 a.s. Qi , 

n E{ WTA^ ' - ^ and 

Since X n+ i jr X n+ x,s = for r ^ s, it follows that 

n 2 £{(z; +lj - z; M ) 2 1 e„} = n 2 z nj - (i - tj f E { —^±M 1 



^ C 1 - Z io)) 2 ^ + Z {j) Z (0 ^ - y j • 

Let i?„+i = (n + l) 2 I Hn (Z* +l>j - Z* n j ) 2 . Since H n G B and P(I Hn ? 1 i.o.) = 0, 
then E{R n+1 \ Q n ) ^ V 3 . On noting that \Z* +1] - Z*J < 



2 



a <(*0 4 » a *(7^)<(^) 



n 2 " v " u "' '" ~ K (S*_ 1 ) 4J ~ K m ' (n-1) 4 
By Lemma [5] (applied with Y n = R n ), 

fc>n fe>n+l 

Since P(Ih„ ^ 1 i-o.) = then n>Ylk>n( Z k+i ■ — Z k -) 2 — ^+ that is, condition 
© holds. 

(ii) C*^ — >tf(0,Uj) stably. 

Define T ni j = Y^k=i X k ,i, Tq^ — 0, and note that 

V™ Z n.j n T n j — Z* , X)i=i T n i 
C ni = ^— 1 -, '±= and 

i + E£i^i i + Eti^,i V" 

i=l k=l i=l i=l 

n do do 

= ^{ X k,j - Z k-l,i ?, X k,i -/Tk,i{ Z k,i ~ Z k-l,j)}- 
k=l i=l i=l 

Define also H n — {2S 1 * > nm} and 

, n do do 

C n*j = —7= Z2 J H k -! {Xk.j ~ Z k-l,j z2 X k,i + 22 Tk-is (E(Zl 3 | Qk-l) - Z k,j)} ■ 



in 

k=l 



Recalling (from point (i)) that P{Ih„ ^ 1 i-O.) = 0, lim„ — — = 1 a.s., and 



E{Z* k .-Z* k _ 1 AQ k _ 1 } 



— (fc-i) 2 a,s " ^ or some constant c, it is not hard to 



see that C* ■ — > N stably if and only if C**- — > N stably for any kernel AT. 
We next prove C**, — ► A/"(0, Uj) stably. For k = 1, . . . , n, let T n ,k — Qk and 



12 PATRIZIA BERTI, IRENE CRIMALDI, LUCA PRATELLI, AND PIETRO RIGO 



^fffe-i { X k,j - Z t-l,j Z)i=l %k,i + Ei=l ( E ( Z k,j I ^fc-l) ^ Z fej) } 
fe — r= 



Since E(Y n ^ \ F n ,k-i) — a.s., the martingale CLT (see Theorem 3.2 of [6|) 
applies. As a consequence, C*j = 5Ifc=i — ► A/"(0, E7j) stably provided 



sup£( max F„ 2 fc ) < oo; max |Y n , fe | -A 0; J2 Y lk ~^ U r 

k=i 



As shown in point (i), /ff fe _j E(Z£ ■ \ Qk-i) — z \ 3 - < a.s. for a suitable 
constant d. Hence, the first two conditions follow from 



rl k < I + h Hk _Ak - i) 2 (E{zt 1 - zy 2 < 2 ( 1 + ,/2) 



To conclude the proof, it remains to see that X]fc=i ^? fe — * Uj ■ After some 
(long) algebra, the latter condition is shown equivalent to 

1 " 

- E - + fc (^fc-w - } 2 ^- ( g ) 

k=l 

Let i?„+i = (n + lfl Hn {Z* +hj - Z* nj f. Since E{R n+1 \ Q n ) ^ V j: as shown in 
point (i), Lemma [5] implies 



1 

k=l 

A direct calculation shows that 
1 " 

~ ^fffk-AXk,] - z k-i,j) 2 ^ Z U)( 1 - z (j))- 

k=l 

Finally, observe the following facts 

( Z n,j ~ -^n+l.j) {Xn+l,j ~ Z n,j) = _ (l _ c>t .' , ! Z n,j( Z n,j ~ Z n+l,j)' 



(n + 1) Z* tj I Hn E(Z* !j - Z* +1J | g„ 



c(n+ 1) a . s . 

— 9 



(» + 1) M %^r^ I e»} > £^ ^ ™ z uy 

a n + A n +i ,j <s„ + P 

Therefore, 

(n + 1) I„,E{ (Z* tj - Z* +hj ) (X n+hj - Z* d ) | Gn) ™ -Z {J) (\ - Z (j) ) 
and Lemma [2] again implies 
2 - 

- / JJg fe -ife(-^fc-ij - ^fcj) (Afej - ^fc-ij) ^ -2Z(j)(\ - Z {j) ). 
fe=l 

Thus condition ([5]) holds, and this concludes the proof. 



□ 
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Remark 10. Point (ii) admits a simpler proof in case EA k ,j = m for all k > 1 and 
1 < j < do. This happens, in particular, if the sequence (A nt i, . . . , A n ^d) is i.i.d.. 
Given the real numbers b\ , . . . , bd , define 



^ do 

Yn,k = —j= ^ bj X k J (AfcJ — EAk,j), J- n ,k =Gk> k = 1, . . . ,7/ 



By Lemma [H J2k=i Y 2 k ~ 4 Sjii fe ~ m2 ) Z U) := ^- Thus, the martingale 
CLT implies Ysk=i Yn,k — ► J\f(0,L) stably. Since b\,...,bd are arbitrary con- 
stants, 



YZ=l X k,j i A k,j - EA kyj ) 



j = 1, • ■ • , do) — ► A/d D (0, E) stably 



where £ is the diagonal matrix with tTjj = (qj — m 2 )Z^jy Let T nj j = X)fc=i -^fcj- 
Since EA k _j = m and -^p- Zq-) > for all j < do, one also obtains 

(^{ ELl ^ fcjAfcj -m} :i = l,...,do)^^ (0,r) stably 



where L is diagonal with jjj — ^ ?J Z( " - ■ Next, write 



r nj j L l i<d ,i 1 tj T n,i r— / Hk=l X k,j A k. 



Ed sr^n y A T T 

i=l Z^fe=l -A-k,islk,i Z^i=l J ",2 ' 



» :'J 



— i — y T ^ /Et=iXk,iA k ,i _ , 

ir^d,Q ^ n Y A X^da rp / t v V rp . I 

2-ii=\ 2-ik=l ^k,i^k,i 2^,i=l ± n,i i<d ,i^j ™' 4 

Clearly, C* ■ — C n j ^> 0. To conclude the proof, it suffices noting that C n j 
converges stably to the Gaussian kernel with mean and variance 

72 



Zrr 



V m J Z m m 2 4^. (l) 



l " i<d ,i^j 



APPENDIX 



Proof of Lemma [3j We first note that N n j ^* oo for each j < do- Arguing 
as in the proof of Proposition 2.3 of [9], in fact, XmLi X n,j = °° a -S-- Hence, 
2fc=i Xkj EAk.j — — * oo, and N n j -^4 oo follows from 

n n 

in = {'0 • X A K/ } = Y. X Ki ( A k,j ~ EA k>j ) 

k=l fc=l 

is a ^-martingale such that \L n+ i — L n \ < /3 for all n. 
We also need the following fact. 

CLAIM: r n j = r^rfx converges a.s. for all j > do and A € (^-, 1). 
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On noting that (1 — x) x < 1 - As for < i < 1 and J^i=i %n,i = > one can 
estimate as follows 

E {I^±hl _ i | g n ) = E{ N nj +X +hj A n+1 , { S^ )X ! ^ _ x 

^ Z nij EA n+ltj +E{( S^ ) x_ ll g n} 

"nj <->n+l 

< _ A f>{ x " + ^: A - +M i g„} 

" i=l ^n+l 



5,, 

= ^ - AE^n+i,!-^-^) a.s.. 

Since limsup„(EM. n+ ij — AE'An+i^) < Ao — Xra < 0, there are e > and hq > 1 
such that EA n+ ij — \EA n+ \,i < — e whenever n > no. Thus, 

^{7"n+i,j— T n ,j | = T n j E{ Tn+1 'i _\ | C/„} < a.s. whenever n> n and 5* > c 

for a suitable constant c. Since 5* > N n _i oo, thus, (t„j) is eventually a non 
negative ^-super-martingale. Hence, r nj converges a.s.. 

Let As (^-, 1). A first consequence of the Claim is that Z n j < J"_: J A for 

each j > do. Letting Y n — X^=i A n ^, this implies 

E{Y n+ i \g n )=^2 Z n .i EA n+1 .i = EA n+ is (1 - ^ z n,i) m. 

Thus, Lemma [2] yields — 11 m. Similarly, ^f- ^+ m. Applying the Claim again, 

n 1 ~ x Z n j = (tt) 1_A (^ l ) X t u j converges a.s. for each j > do- 

Since j > d and A e 1) are arbitrary, it follows that n 1 ~ x J2j=d +i 
for each A > ^. 

m 

Next, fix j < do- For Z„.j to converge a.s., it suffices that 

}^E{Z n+ i tj - Z nt j I g n } and } E{(Z n+ ij - Z n j) 2 \ G n ) converge a.s.; 



see Lemma 3.2 of Since 



A„+lj- A n+ ij ^ ^"+M ^"+1, 



7 _ 7 _ ^n+l,j -^n+l,j _ 7 



S n + A n +i j S n + A n +i^i 

then \Z n+ i t j — Z n _j \ < Hence, 

Y^E{{Z n+ld - Z nj ) 2 | g n } < d 2 l3 2 Y^\ (^~) 2 < a.s.. 
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Moreover, 

A n +i ■ d Ai+i i 

E{Z n+ ij - Z n j | Q n ) = Z nJ E{ — " J — | g n } - Z n j v z, hi E{ — " '- — I Q n ) 

A 2 +1 - d ^ 2 +i ■ 

'"' ^ S n (S n + A n+ ij) ^ ^ ' ^ ^n{S n + A n+ ij) ^ 

+ ^™>j c + J — ^n,) ^n,» c + a .S., and 

d d 

EA n+ ij — Z n s EA n+ is ~ EA n+ i^\ Z„ ; i — Z n sEA n+ i^. 

Therefore, ^ n E{Z n+ ij — Z n _j \ Q n } converges a.s. since 

E{z n+1J - z nJ | g n } < ^ + 2/3 E^ rfo +i^M = o( ^ A _ 2) ag for cach A e ^ 

Thus, Z nj for some random variable Zrjy To conclude the proof, we 

let Y n j = log and prove that 

converge a.s. whenever i < do. 

n n 

In this case, in fact, log converges a.s. for each i < do and this implies Z^ > 
a.s. for each i < <1q. 

Since Y n+hi - Y n , t = X n+hi log(l + 4v~) - X n+hl log(l + then 

E{Y n+1<i -Y n ,i | g n ) = Z IM S{log(l+^M) | g n }-Z n . 1 E{\og{\+^^-) I g„} a.s.. 

JV„,i ' 7V„ i 

Since EA n +\^ = EA n+ \ t \, a second order Taylor expansion of x log(l + a;) yields 

£7{y n+ i,< - y n>i | Q n ) <^(^ + ^~) a.s.. 
A quite similar estimate holds for E{(Y n+ i t i — Y n: i) 2 \ Q n }- Thus, it suffices to see 



E — < oo a.s. for each i < do- 



£ AT 

Define i?„,i = where u e (0, 1) and i < d a . Since (1 + x) u < 1 + ux for x > 0, 

one can estimate as 

^ Tr(^n+l~^n . ,X n +i iA n +i i , 

< uE { S* I Gn} - ^1 ^ + I ^} 

p— 1 
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As in the proof of the Claim, thus, 

R 

E{R n+1 .i - R n s | g n ) = R n s E{ " + '- - 1 I Q n } < a.s. whenever N n s > c 

for a suitable constant c. Since N n ,i ^> oo, then (R n s) is eventually a non negative 
^-super-martingale, so that R n ,i converges a.s.. Hence, 

El _ Rn.i _ „ n , n n u 1 

This concludes the proof. 

□ 
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